Sensor device and methods of use

ABSTRACT

A multispectral sensor device may include a sensor array comprising a plurality of channels and one or more processors to determine that a time-sensitive measurement is to be performed, wherein the time-sensitive measurement is to be performed using data collected by one or more channels of the plurality of channels; cause the data to be collected by a proper subset of channels, of the plurality of channels, wherein the proper subset of channels includes the one or more channels; and determine the time-sensitive measurement based on the data.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/948,148, filed Sep. 4, 2020 (now U.S. Pat. No. 11,237,051), which isa continuation of U.S. patent application Ser. No. 16/102,259, filedAug. 13, 2018 (now U.S. Pat. No. 10,768,047), which claims priority toU.S. Provisional Patent Application No. 62/631,352, filed Feb. 15, 2018,the contents of each of which are incorporated herein by reference intheir entireties.

BACKGROUND

A multispectral sensor device may be utilized to capture information.For example, the multispectral sensor device may capture informationrelating to a set of electromagnetic frequencies. The multispectralsensor device may include a set of sensor elements (e.g., opticalsensors, spectral sensors, and/or image sensors) that capture theinformation. For example, an array of sensor elements may be utilized tocapture information relating to multiple frequencies. A particularsensor element, of the sensor element array, may be associated with afilter that restricts a range of frequencies that are directed towardthe particular sensor element. The filter may be associated with aparticular bandwidth corresponding to a width of a spectral range thatthe filter passes toward the particular sensor element.

SUMMARY

In some possible implementations, a multispectral sensor device mayinclude a sensor array comprising a plurality of channels and one ormore processors to determine that a time-sensitive measurement is to beperformed, wherein the time-sensitive measurement is to be performedusing data collected by one or more channels of the plurality ofchannels; cause the data to be collected by a proper subset of channels,of the plurality of channels, wherein the proper subset of channelsincludes the one or more channels; and determine the time-sensitivemeasurement based on the data.

In some possible implementations, a method may include determining, by amultispectral sensor device, that a measurement is to be performed,wherein the measurement is to be performed using data collected by oneor more channels of a plurality of channels of the multispectral sensordevice, and wherein the measurement is associated with a timesensitivity; causing, by the multispectral sensor device, the data to becollected by a proper subset of channels, of the plurality of channels,wherein the proper subset of channels includes the one or more channels;and determining, by the multispectral sensor device, the measurementbased on the data.

In some possible implementations, a non-transitory computer-readablemedium may store one or more instructions that, when executed by one ormore processors of a multispectral sensor device, cause the one or moreprocessors to determine that a first measurement and a secondmeasurement are to be performed, wherein the first measurement is to beperformed using first data collected by one or more first channels of aplurality of channels of the multispectral sensor device, wherein thesecond measurement is to be performed using second data collected by oneor more second channels of the plurality of channels, and wherein thefirst measurement is associated with a greater time sensitivity than thesecond measurement; cause the first data to be collected by a propersubset of channels, of the plurality of channels, wherein the propersubset of channels includes the one or more first channels; cause thesecond data to be collected, wherein the multispectral sensor device isconfigured to activate all channels of the plurality of channels tocause the second data to be collected; determine the first measurementbased on the first data; and determine the second measurement based onthe second data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1D are diagrams of an overview of an example implementationdescribed herein.

FIG. 2 is a diagram of an example environment in which systems and/ormethods, described herein, may be implemented.

FIG. 3 is a diagram of example components of one or more devices of FIG.2 .

FIG. 4 is a flow chart of an example process for region-of-interest(ROI) processing for time-sensitive measurement.

FIG. 5 is a flow chart of another example process for region-of-interest(ROI) processing for time-sensitive measurement.

DETAILED DESCRIPTION

The following detailed description of example implementations refers tothe accompanying drawings. The same reference numbers in differentdrawings may identify the same or similar elements.

Frame rates used for time-dependent optical measurements, such as thosefound in health monitoring applications (e.g., heartbeat, bloodpressure, etc.), are sometimes in a range of 250 to 500 samples persecond (sps). In a multispectral sensor that utilizes multiple pixelregions of a single image sensor, high readout speeds for the fullsensor can be limited by the maximum data transfer rates achievable inthe imaging system. This may be an image sensor readout architectureissue, and a system bus issue. High resolution, high speed sensors withhigh bit depth require complex circuits that increase the cost and sizeof a device. For sensors of good size, cost, bit depth, andresponsivity, it may be difficult to achieve 250 sps at full resolution.In space-constrained consumer electronics applications where size andcost are design considerations, high frame rates at high resolution athigh bit depth may be difficult to achieve.

Implementations described herein may maintain high resolution, high bitdepth, and high frame rates without exceeding a data transfer rate of animaging system by processing only certain regions of interest (ROIs)from a sensor image. For example, specific time-sensitive spectralchannel measurements can be taken at high frame rate (e.g., at full ROIresolution and/or bit depth). The time-sensitive measurements may beused, for example, for processing time-dependent parameters, such ascertain health parameters. The full spectral sensor can be operated at aslower rate for measurements that require the full spectral channel set,and/or at intermediate frame rates for any mixture of the dataparameters that do not exceed the data bus rate of the spectrometer. ROIprocessing can be performed by a camera's sensor through partialscanning (for charge-coupled device (CCD)-based devices) or windowing(for complementary metal-oxide semiconductor (CMOS)-based devices). Byperforming ROI processing using partial scanning or windowing fortime-sensitive or frequently-performed measurements, a data bus rate ofthe multispectral sensor may not be exceeded, which preserves the timedimension of the time-sensitive measurement, thereby improvingmeasurement accuracy. Furthermore, some implementations described hereinmay be performed on a chip of the multispectral sensor device (e.g.,before passing the data to a control device), which reduces latency andimproves temporal measurement accuracy of the measurements.

FIGS. 1A-1D are diagrams of an overview of an example implementation 100described herein. As shown in FIG. 1A, example implementation 100 may beperformed by a multispectral sensor device, such as a multispectralsensor device employing a CMOS device or a CCD (e.g., multispectralsensor device 220 of FIG. 2 ). In some implementations, certainoperations of example implementation 100 may be performed by anotherdevice of environment 200 of FIG. 2 , such as control device 210.

As shown in FIG. 1 , the multispectral sensor device may include asensor array 105. As shown, sensor array 105 may include channels 110-1through 110-64. For example, a sensor array may include multiple sensorelements configured to obtain information regarding multiplecorresponding frequencies. Additionally, or alternatively, a sensorarray may include multiple sensor elements configured to obtaininformation associated with a single frequency. A sensor element maycorrespond to a channel 110.

As shown in FIG. 1B, and by reference number 120, the multispectralsensor device may perform measurements based on the regions 115. Theperformance of the measurements is described in more detail inconnection with FIGS. 1C and 1D, below. As shown by reference number125, the multispectral sensor device may perform a measurement 1 usingchannels 10, 11, 18, and 19 of the sensor array 105. As further shown,the multispectral sensor device may perform a measurement 2 using allchannels of the multispectral sensor device. Here, measurement 1 usesfour channels, which may collectively be referred to as a pixel regionor a region of interest (ROI). As shown, measurement 2 uses all channelsof the sensor array 105. In some implementations, measurement 2 may useless than all channels of the sensor array 105.

For the purpose of example implementation 100, assume that measurement 1is a time-sensitive measurement, and assume that measurement 2 is not atime-sensitive measurement. As used herein, a time-sensitive measurementmay refer to a measurement that is associated with a threshold framerate, a threshold data rate, a measurement for which an accurate timemeasurement is needed for accuracy, and/or the like. Anon-time-sensitive measurement may refer to a measurement that is notassociated with a threshold frame rate or data rate, a measurement forwhich an accurate time measurement is not needed, and/or the like. Insome implementations, a time-sensitive measurement may be associatedwith a particular frame rate and/or resolution that would collectivelyexceed a bus data rate of the multispectral sensor device. When the busdata rate is exceeded, data may be queued, thereby losing a timedimension of the data. This may reduce the accuracy of sometime-sensitive measurements.

As shown in FIG. 1C, and by reference number 130, the multispectralsensor device may determine that measurement 1 is a time-sensitivemeasurement. As further shown, the multispectral sensor device maycollect data only for the channels associated with measurement 1(channels 10, 11, 18, and 19, shown by the diagonal hatching). In someimplementations, the multispectral sensor device may collect the datausing ROI windowing, as described in more detail below. In someimplementations, the multispectral sensor device may collect the datausing partial scanning of the sensor array 105, as is also described inmore detail below.

In some implementations, such as when the multispectral sensor deviceincludes a CCD-based device, the multispectral sensor device may collectthe data using partial scanning of the sensor array 105. For example,partial scanning may be accomplished by performing a number of (e.g.,consecutive) vertical shifts into the readout register and discardingthe unwanted or unneeded charge (e.g., unwanted or unneeded dataassociated with channels other than channels 10, 11, 18, and 19).Without the need to output each pixel in the row, the vertical transferscan be done quickly relative to reading the full row, which provides anincrease in frame rate due to the sensor outputting fewer rows in eachframe. Once the ROI scan for measurement 1 has been achieved, the sensorarray 105 may be operated normally, outputting pixels from theappropriate rows (as described in more detail in connection with FIG.1D, below.

In some implementations, such as when the multispectral sensor deviceincludes a CMOS-based device, the multispectral sensor device maycollect the data using ROI windowing. For example, for somearchitectures of the CMOS sensor, both vertical and horizontal windowingcan be performed. In some implementations, this allows a correspondingincrease in frame rate, since pixel signals are sent in parallel througha bank of column amplifiers, followed by column analog to digitalconverters (A/Ds), and finally into a high-speed multiplexer that sendsthe digitized data off-chip. The integration of parallel on-chip A/Ds ina CMOS chip can allow for high pixel clocks with high frame rates.

In some implementations, windowing with CMOS sensors can extend beyond asingle window to multiple windows by properly addressing the correctrows and columns of interest. With multiple windows or ROIs, themultispectral sensor device can improve utilization of the sensor outputbandwidth for useful information without exceeding the bus data rate. Inthis way, the multispectral sensor device may improve measurementfrequency and accuracy for time-sensitive measurements.

As shown in FIG. 1D, and by reference number 135, in someimplementations, the multispectral sensor device may determine thatmeasurement 2 is not time-sensitive. Accordingly, the multispectralsensor device may collect data using the full sensor array 105, and maydetermine measurement 2 based on the collected data. For example, themultispectral sensor device may collect data for each channel of sensorarray 105. In some implementations, the multispectral sensor device maycollect data for remaining channels other than channels 10, 11, 18,and/or 19, which may conserve resources that would otherwise be used tocollect unnecessary data from channels 10, 11, 18, and/or 19. In someimplementations, the multispectral sensor device may collect data at afull resolution for all channels of the sensor array 105, which enablesmore accurate determination of non-time-sensitive measurements.

As an example of the operations described in connection with FIGS.1A-1D, above, consider the case of a 64-channel multispectral sensorachieved by integration of a monolithic multispectral filter onto apixelated sensor (such as a common silicon CMOS image sensor) as abio-monitoring device to measure heartbeat, blood pressure, SpO2, bloodglucose, hydration, and/or other health parameters. Cardiopulmonaryfunction parameters of heartbeat, blood pressure, and SpO2 may requiretime-sensitive (e.g., greater than 250 sps) measurements oftime-dependent spectral signals in a small number of wavelengths.Utilizing the multispectral ROI windowing technique, data in specificchannels corresponding to the small number of wavelengths can bedetermined at a speed sufficient to meet the temporal samplingrequirements and calculate the necessary measurements. Whendetermination of the time-sensitive measurements has been completed, themultispectral sensor may perform a full sensor readout that captures theremaining channels of data in a full readout (e.g., of all 64 channels).This information can be used to determine other spectral healthparameters such as blood glucose, hydration, etc. that are nottime-dependent but may have need of highly-resolved spectral content.

In this way, the multispectral ROI windowing technique achieves highresolution, high bit depth and high frame rate that would otherwisenecessitate complex architectures that would add significant cost andsize to a device. For example, other techniques, such as stacking wafersto integrate specialized readout circuits directly to each pixel, or thecreation of specialized circuitry to run very fast data collection maynot be suitable for achieving low cost and high manufacturability.Additionally, without ROI techniques to discard the extra data that isnot useful, large amounts of data would need to be processed before auseful signal could be calculated and reported back to the user, thusdestroying the time-sensitive aspects of the measurements.

Example implementation 100 is described from the perspective of atwo-dimensional sensor array. However, implementations described hereincan be applied for three-dimensional sensor arrays as well. For example,the regions of interest for such a sensor array could be one-dimensional(e.g., a single channel or a line of channels), two-dimensional (e.g., alayer of channels), or three dimensional (e.g., two or more layers ofone or more channels).

As indicated above, FIGS. 1A-1D are provided merely as an example. Otherexamples are possible and may differ from what was described with regardto FIGS. 1A-1D.

FIG. 2 is a diagram of an example environment 200 in which systemsand/or methods, described herein, may be implemented. As shown in FIG. 2, environment 200 may include a control device 210, a multispectralsensor device 220, and a network 230. Devices of environment 200 mayinterconnect via wired connections, wireless connections, or acombination of wired and wireless connections.

Control device 210 includes one or more devices capable of storing,processing, and/or routing information associated with multispectralsensing. For example, control device 210 may include a server, acomputer, a wearable device, a cloud computing device, and/or the like.In some implementations, control device 210 may be associated with aparticular multispectral sensor device 220. In some implementations,control device 210 may be associated with multiple multispectral sensordevices 220. In some implementations, control device 210 may receiveinformation from and/or transmit information to another device inenvironment 100, such as multispectral sensor device 220.

Multispectral sensor device 220 includes a device capable of performinga measurement of light directed toward multispectral sensor device 220.For example, multispectral sensor device 220 may include an imagesensor, a multispectral sensor, and/or the like that may perform asensor measurement of light directed toward multispectral sensor device220. Multispectral sensor device 220 may utilize one or more sensortechnologies, such as a complementary metal-oxide-semiconductor (CMOS)technology, a charge-coupled device (CCD) technology, and/or the like.Multispectral sensor device 220 may include multiple sensor elements(e.g., an array of sensor elements—referred to as a sensor array) eachconfigured to obtain information. A sensor element may correspond to achannel, such as channel 115 described in FIG. 1A.

Network 230 includes one or more wired and/or wireless networks. Forexample, network 230 may include a cellular network (e.g., a long-termevolution (LTE) network, a code division multiple access (CDMA) network,a 3G network, a 4G network, a 5G network, another type of nextgeneration network, etc.), a public land mobile network (PLMN), a localarea network (LAN), a wide area network (WAN), a metropolitan areanetwork (MAN), a telephone network (e.g., the Public Switched TelephoneNetwork (PSTN)), a private network, an ad hoc network, an intranet, theInternet, a fiber optic-based network, a cloud computing network, or thelike, and/or a combination of these or other types of networks.

The number and arrangement of devices and networks shown in FIG. 2 areprovided as an example. In practice, there may be additional devicesand/or networks, fewer devices and/or networks, different devices and/ornetworks, or differently arranged devices and/or networks than thoseshown in FIG. 2 . Furthermore, two or more devices shown in FIG. 2 maybe implemented within a single device, or a single device shown in FIG.2 may be implemented as multiple, distributed devices. Additionally, oralternatively, a set of devices (e.g., one or more devices) ofenvironment 200 may perform one or more functions described as beingperformed by another set of devices of environment 200.

FIG. 3 is a diagram of example components of a device 300. Device 300may correspond to control device 210 and/or multispectral sensor device220. In some implementations, control device 210 and/or multispectralsensor device 220 may include one or more devices 300 and/or one or morecomponents of device 300. As shown in FIG. 3 , device 300 may include abus 310, a processor 320, a memory 330, a storage component 340, aninput component 350, an output component 360, and a communicationinterface 370.

Bus 310 includes a component that permits communication among thecomponents of device 300. Processor 320 is implemented in hardware,firmware, or a combination of hardware and software. Processor 320 takesthe form of a central processing unit (CPU), a graphics processing unit(GPU), an accelerated processing unit (APU), a microprocessor, amicrocontroller, a field-programmable gate array (FPGA), anapplication-specific integrated circuit (ASIC), or another type ofprocessing component. In some implementations, processor 320 includesone or more processors capable of being programmed to perform afunction. Memory 330 includes a random access memory (RAM), a read onlymemory (ROM), and/or another type of dynamic or static storage device(e.g., a flash memory, a magnetic memory, and/or an optical memory) thatstores information and/or instructions for use by processor 320.

Storage component 340 stores information and/or software related to theoperation and use of device 300. For example, storage component 340 mayinclude a hard disk (e.g., a magnetic disk, an optical disk, amagneto-optic disk, and/or a solid state disk), a compact disc (CD), adigital versatile disc (DVD), a floppy disk, a cartridge, a magnetictape, and/or another type of non-transitory computer-readable medium,along with a corresponding drive.

Input component 350 includes a component that permits device 300 toreceive information, such as via user input (e.g., a touch screendisplay, a keyboard, a keypad, a mouse, a button, a switch, and/or amicrophone). Additionally, or alternatively, input component 350 mayinclude a sensor for sensing information (e.g., a global positioningsystem (GPS) component, an accelerometer, a gyroscope, and/or anactuator). Output component 360 includes a component that providesoutput information from device 300 (e.g., a display, a speaker, and/orone or more light-emitting diodes (LEDs)).

Communication interface 370 includes a transceiver-like component (e.g.,a transceiver and/or a separate receiver and transmitter) that enablesdevice 300 to communicate with other devices, such as via a wiredconnection, a wireless connection, or a combination of wired andwireless connections. Communication interface 370 may permit device 300to receive information from another device and/or provide information toanother device. For example, communication interface 370 may include anEthernet interface, an optical interface, a coaxial interface, aninfrared interface, a radio frequency (RF) interface, a universal serialbus (USB) interface, a Wi-Fi interface, a cellular network interface, orthe like.

Device 300 may perform one or more processes described herein. Device300 may perform these processes based on processor 320 executingsoftware instructions stored by a non-transitory computer-readablemedium, such as memory 330 and/or storage component 340. Acomputer-readable medium is defined herein as a non-transitory memorydevice. A memory device includes memory space within a single physicalstorage device or memory space spread across multiple physical storagedevices.

Software instructions may be read into memory 330 and/or storagecomponent 340 from another computer-readable medium or from anotherdevice via communication interface 370. When executed, softwareinstructions stored in memory 330 and/or storage component 340 may causeprocessor 320 to perform one or more processes described herein.Additionally, or alternatively, hardwired circuitry may be used in placeof or in combination with software instructions to perform one or moreprocesses described herein. Thus, implementations described herein arenot limited to any specific combination of hardware circuitry andsoftware.

The number and arrangement of components shown in FIG. 3 are provided asan example. In practice, device 300 may include additional components,fewer components, different components, or differently arrangedcomponents than those shown in FIG. 3 . Additionally, or alternatively,a set of components (e.g., one or more components) of device 300 mayperform one or more functions described as being performed by anotherset of components of device 300.

FIG. 4 is a flow chart of an example process 400 for ROI windowing formultispectral measurement. In some implementations, one or more processblocks of FIG. 4 may be performed by multispectral sensor device 220. Insome implementations, one or more process blocks of FIG. 4 may beperformed by another device or a group of devices separate from orincluding multispectral sensor device 220, such as control device 210.

As shown in FIG. 4 , process 400 may include determining that atime-sensitive measurement is to be performed, wherein thetime-sensitive measurement is to be performed using data collected byone or more channels of a plurality of channels (block 410). Forexample, multispectral sensor device 220 (e.g., using processor 320and/or the like) may determine that a time-sensitive measurement is tobe performed. The time-sensitive measurement may be performed using datacollected by one or more channels of a sensor array (e.g., in a regionof interest associated with the time-sensitive measurement). In someimplementations, determining the measurement may be performedautomatically by multispectral sensor device 220 (e.g., based onfeedback). In some implementations, the measurement may be configured(e.g., a particular measurement requires 250 sps).

As further shown in FIG. 4 , process 400 may include causing the data tobe collected by a proper subset of channels, of the plurality ofchannels, wherein the proper subset of channels includes the one or morechannels (block 420). For example, multispectral sensor device 220(e.g., using processor 320) may cause the data to be collected by aproper subset of channels (e.g., less than all channels) of theplurality of channels. The proper subset of channels may include the oneor more channels in the region of interest. In some implementations,multispectral sensor device 220 may cause the data to be collected usingan ROI windowing approach or a partial scanning approach, as describedin more detail elsewhere herein.

As further shown in FIG. 4 , process 400 may include determining thetime-sensitive measurement based on the data (block 430). For example,multispectral sensor device 220 (e.g., using processor 320) maydetermine the time-sensitive measurement based on the data. In this way,a data bus rate of multispectral sensor device 220 is not exceeded forthe time-sensitive measurement. In some implementations, multispectralsensor device 220 may provide the data to another device (e.g., controldevice 210) that may determine the data.

Process 400 may include additional implementations, such as any singleimplementation or any combination of implementation described belowand/or in connection with one or more other processes describedelsewhere herein.

In some implementations, the proper subset of channels includes only theone or more channels. In some implementations, the proper subset ofchannels includes one or more rows of sensors, wherein the one or morerows include the one or more channels. In some implementations,multispectral sensor device 220 may discard data other than the datacollected by the one or more channels. In some implementations,multispectral sensor device 220 may cause the data to be collected bythe proper subset of channels based on a time sensitivity of thetime-sensitive measurement. In some implementations, the time-sensitivemeasurement is a first measurement and the data is first data.Multispectral sensor device 220 may determine that a second measurementis to be performed, wherein the second measurement is associated with aless stringent time sensitivity than the first measurement; cause seconddata to be collected by all channels of the plurality of channels; andperform the second measurement using at least part of the second data.In some implementations, the multispectral sensor device may performmultiple iterations of the first measurement and the second measurement,wherein the first measurement is performed more frequently than thesecond measurement. In some implementations, the first measurement isdetermined with less latency than the second measurement. In someimplementations, the first measurement is performed more frequently thanthe second measurement.

In some implementations, the sensor array includes at least one of acharge-coupled device or a complementary metal-oxide semiconductordevice. In some implementations, the time-sensitive measurement is for abiological or medical value.

In some implementations, the multispectral sensor device 220 includes acomplementary metal-oxide semiconductor device. The multispectral sensordevice 220 may perform vertical and horizontal windowing so that thedata is collected only by the one or more channels. In someimplementations, the multispectral sensor device 220 includes acharge-coupled device. The multispectral sensor device may perform oneor more consecutive vertical shifts into a readout register and discarddata other than the data to be collected. In some implementations,particular data from the one or more rows is not associated with the oneor more channels and the particular data is dropped for determining themeasurement.

Although FIG. 4 shows example blocks of process 400, in someimplementations, process 400 may include additional blocks, fewerblocks, different blocks, or differently arranged blocks than thosedepicted in FIG. 4 . Additionally, or alternatively, two or more of theblocks of process 400 may be performed in parallel.

FIG. 5 is a flow chart of another example process 500 for ROI windowingfor multispectral measurement. In some implementations, one or moreprocess blocks of FIG. 5 may be performed by multispectral sensor device220. In some implementations, one or more process blocks of FIG. 5 maybe performed by another device or a group of devices separate from orincluding multispectral sensor device 220, such as control device 210.

As shown in FIG. 5 , process 500 may include determining that a firstmeasurement and a second measurement are to be performed, wherein thefirst measurement is associated with a greater time sensitivity than thesecond measurement (block 510). For example, multispectral sensor device220 (e.g., using processor 320) may determine that a first measurementand a second measurement are to be performed. The first measurement maybe associated with a greater time sensitivity than the secondmeasurement. In some implementations, the first measurement may beassociated with a higher data rate, frame rate, and/or resolution thanthe second measurement.

As further shown in FIG. 5 , process 500 may include causing the firstdata to be collected by a proper subset of channels, of the plurality ofchannels, wherein the proper subset of channels includes the one or morefirst channels (block 520). For example, multispectral sensor device 220(e.g., using processor 320) may cause the first data to be collected bya proper subset of channels of the plurality of channels. The propersubset of channels may include a region of interest corresponding to theone or more first channels.

As further shown in FIG. 5 , process 500 may include causing the seconddata to be collected, wherein multispectral sensor device 220 isconfigured to activate all channels of the plurality of channels tocause the second data to be collected (block 530). For example,multispectral sensor device 220 (e.g., using processor 320) may causethe second data to be collected. Multispectral sensor device 220 mayactivate all channels, of the plurality of channels, to cause the seconddata to be collected.

As further shown in FIG. 5 , process 500 may include determining thefirst measurement based on the first data (block 540). For example,multispectral sensor device 220 (e.g., using processor 320) maydetermine the first measurement based on the first data. In someimplementations, multispectral sensor device 220 may provide the firstdata to another device (e.g., control device 210) for determination ofthe first measurement.

As further shown in FIG. 5 , process 500 may include determining thesecond measurement based on the second data (block 550). For example,multispectral sensor device 220 (e.g., using processor 320) maydetermine the second measurement based on the second data. In someimplementations, multispectral sensor device 220 may provide the seconddata to another device (e.g., control device 210) for determination ofthe second measurement.

Process 500 may include additional implementations, such as any singleimplementation or any combination of implementation described belowand/or in connection with one or more other processes describedelsewhere herein.

In some implementations, multispectral sensor device 220 may performmultiple iterations of the first measurement and the second measurement,wherein the first measurement is performed more frequently than thesecond measurement. In some implementations, the first measurement isdetermined with less latency than the second measurement. In someimplementations, the multispectral sensor device includes acharge-coupled device or a complementary metal-oxide semiconductordevice.

Although FIG. 5 shows example blocks of process 500, in someimplementations, process 500 may include additional blocks, fewerblocks, different blocks, or differently arranged blocks than thosedepicted in FIG. 5 . Additionally, or alternatively, two or more of theblocks of process 500 may be performed in parallel.

In this way, the multispectral ROI windowing technique achieves highresolution, high bit depth and high frame rate that would otherwisenecessitate complex architectures that would add significant cost andsize to a device. For example, other techniques, such as stacking wafersto integrate specialized readout circuits directly to each pixel, or thecreation of specialized circuitry to run very fast data collection maynot be suitable for achieving low cost and high manufacturability.Additionally, without ROI techniques to discard the extra data that isnot useful, large amounts of data would need to be processed before auseful signal could be calculated and reported back to the user, thusdestroying the time-sensitive aspects of the measurements.

The foregoing disclosure provides illustration and description, but isnot intended to be exhaustive or to limit the implementations to theprecise form disclosed. Modifications and variations are possible inlight of the above disclosure or may be acquired from practice of theimplementations.

As used herein, the term component is intended to be broadly construedas hardware, firmware, and/or a combination of hardware and software.

Some implementations are described herein in connection with thresholds.As used herein, satisfying a threshold may refer to a value beinggreater than the threshold, more than the threshold, higher than thethreshold, greater than or equal to the threshold, less than thethreshold, fewer than the threshold, lower than the threshold, less thanor equal to the threshold, equal to the threshold, or the like.

It will be apparent that systems and/or methods, described herein, maybe implemented in different forms of hardware, firmware, or acombination of hardware and software. The actual specialized controlhardware or software code used to implement these systems and/or methodsis not limiting of the implementations. Thus, the operation and behaviorof the systems and/or methods were described herein without reference tospecific software code—it being understood that software and hardwarecan be designed to implement the systems and/or methods based on thedescription herein.

Even though particular combinations of features are recited in theclaims and/or disclosed in the specification, these combinations are notintended to limit the disclosure of possible implementations. In fact,many of these features may be combined in ways not specifically recitedin the claims and/or disclosed in the specification. Although eachdependent claim listed below may directly depend on only one claim, thedisclosure of possible implementations includes each dependent claim incombination with every other claim in the claim set.

No element, act, or instruction used herein should be construed ascritical or essential unless explicitly described as such. Also, as usedherein, the articles “a” and “an” are intended to include one or moreitems, and may be used interchangeably with “one or more.” Furthermore,as used herein, the term “set” is intended to include one or more items(e.g., related items, unrelated items, a combination of related items,and unrelated items, etc.), and may be used interchangeably with “one ormore.” Where only one item is intended, the term “one” or similarlanguage is used. Also, as used herein, the terms “has,” “have,”“having,” or the like are intended to be open-ended terms. Further, thephrase “based on” is intended to mean “based, at least in part, on”unless explicitly stated otherwise.

What is claimed is:
 1. A method, comprising: causing, by a multispectralsensor device and for a first measurement, first data to be collected bya first subset of channels of a plurality of channels, wherein the firstsubset of channels is less than all channels of the plurality ofchannels; and causing, by the multispectral sensor device and for asecond measurement, second data to be collected by a second subset ofchannels of the plurality of channels, wherein the first subset ofchannels is different from the second subset of channels, and wherein afirst time sensitivity of the first measurement is greater than a secondtime sensitivity of the second measurement.
 2. The method of claim 1,wherein the first data is caused to be collected by the first subset ofchannels based on the first time sensitivity of the first measurement,and wherein the second data is caused to be collected by the secondsubset of channels based on the second time sensitivity of the secondmeasurement.
 3. The method of claim 1, further comprising one or moreof: determining the first measurement based on the first data, orproviding the first data to another device for determination of thefirst measurement.
 4. The method of claim 1, wherein a first frequencyof the first measurement is different from a second frequency of thesecond measurement.
 5. The method of claim 1, wherein the firstmeasurement is determined with a first latency, wherein the secondmeasurement is determined with from a second latency, and wherein thefirst latency is different from the second latency.
 6. The method ofclaim 1, further comprising: determining that the first measurement andthe second measurement are to be performed.
 7. The method of claim 1,wherein the first measurement is associated with a first frame rate,wherein the second measurement is associated with a second frame rate,and wherein the second frame rate is different from the first framerate.
 8. The method of claim 1, wherein the first measurement isassociated with a first resolution, wherein the second measurement isassociated with a second resolution, and wherein the first resolution isdifferent from the second resolution.
 9. The method of claim 1, whereinthe first subset of channels include a region of interest associatedwith the first measurement.
 10. A device, comprising: one or morememories; and one or more processors, coupled to the one or morememories, configured to: cause, for a first measurement and based on afirst time sensitivity of the first measurement, first data to becollected by a first subset of channels of a plurality of channels; andcause, for a second measurement and based on a second time sensitivityof the second measurement, second data to be collected by a secondsubset of channels of the plurality of channels, wherein the second timesensitivity of the second measurement is less stringent than the firsttime sensitivity of the first measurement.
 11. The device of claim 10,wherein the first subset of channels is less than all channels of theplurality of channels.
 12. The device of claim 10, wherein the one ormore processors are further configured to: determine the firstmeasurement based on the first data, and determine the secondmeasurement based on second data.
 13. The device of claim 10, whereinmultiple iterations of the first measurement and the second measurementare performed.
 14. The device of claim 10, wherein the first measurementis associated with a higher data rate or resolution than the secondmeasurement.
 15. A method, comprising: determining, by using a firstsubset of channels of a plurality of channels of a multispectral sensordevice, a first measurement for a first health parameter; anddetermining, by using a second subset of channels of the plurality ofchannels of the multispectral sensor device, a second measurement for asecond health parameter, wherein the first subset of channels isdifferent from the second subset of channels, and wherein a first timesensitivity of the first measurement is greater than a second timesensitivity of the second measurement.
 16. The method of claim 15,wherein the second measurement is determined after the first measurementis completed.
 17. The method of claim 15, wherein the multispectralsensor device includes a 64-channel multispectral sensor.
 18. The methodof claim 15, wherein the multispectral sensor device includes amonolithic multispectral filter that is integrated onto a pixelatedsensor.
 19. The method of claim 15, wherein the first health parameteris a cardiopulmonary function parameter of heartbeat, blood pressure, orSpO2 that requires more than 250 samples per second measurements oftime-dependent spectral signals in a small number of wavelengths, andwherein the second health parameter is a spectral health parameter thatis not time-dependent.
 20. The method of claim 15, wherein the secondsubset of channels is all 64 channels of the plurality of channels.